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Abstract. In this paper, we study the Gevrey regularity of weak solutions for 
a class of linear and semi-linear kinetic equations, which are the linear model 
of spatially inhomogeneous Boltzmann equations without an angular cutoff. 



1. Introduction 

In this paper, we study the following kinetic operator: 

(1.1) V = d t + v-d x + a{t,x,v)(-l\ v y, (t, i,«)elxR"x W 1 , 

where < a < 1, v ■ d x = T^ =lVj d X] , a(t,x,v) e C°°(R 2n+1 ) and a(t,x,v) > 
on K x R n x R", the notation (— A v ) a denotes the Fourier multiplier of symbol 
p(rj) = { \r]\ a ui{r]) + \r}\ (1 - w(ry))} 2 , with u)(r]) G C°°(R"), < u < 1. Moreover, 
we have oj = 1 if \r)\ > 2 and u> = if |ry| < 1. Throughout the paper, we denote by 
u(t, £, rj) the Fourier transform of u with respect to the variables (t, x,v). V is not a 
classical pseudo-differential operator in R 2n+1 ; for the coefficient in the kinetic part 
is not bounded in M 2n+1 . When a = 1, the operator (1.1) is the so-called Vlasov- 
Fokkcr-Planck operator (see [HJ[T3]), it is then a Hormander type operators, and 
we can apply the Gevrey hypoellipticity results of M. Derridj and C. Zuily [7] and 
M. Durand [TU], see also [5] for the optimal G 3 -hypoelliptic results. 

As is well known, the operator (1.1) is a linear model of the spatially inhomo- 
geneous Boltzmann equation without an angular cutoff (cf. |15|). This is the main 
motivation for the study of the regularizing properties of the operator (1.1) in this 
paper. In the past several years, a lot of progress has been made in the study 
of the spatially homogeneous Boltzmann equation without an angular cutoff, (see 
[21 IS [3 [21] and references therein), in which the authors have proved that the 
singularity of the collision cross-section yields certain gain on the regularity for the 
weak solution of the Cauchy problem in the Sobolev space frame. That implies 
that there exists a C°° smoothness effect of the Cauchy problem for the spatially 
homogeneous Boltzmann equation without an angular cutoff. The Gevrey regular- 
ity of the local solutions has been constructed in [3^ for the initial data having 
the same Gevrey regularity, and the propagation of Gevrey regularity is proved re- 
cently in [5] . In [T7] , the Gevrey smoothness effect of the Cauchy problem has been 
established for the spatially homogeneous linear Boltzmann equation. In |16j . they 
obtain the ultra-analytical effect results for the non linear homogeneous Landau 
equations and inhomogeneous linear Landau equations. 
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However, there is no general result for the smoothness effect of the spatially 
inhomogeneous problem, which is actually related with the regularity of the ki- 
netic equation with its diffusion part a nonlinear operator in the velocity variable 
v. Under the singularity assumption on the collision cross section, the behavior 
of the Boltzmann collision operator is similar to a fractional power of the Lapla- 
cian (— A„) CT . In pQ, by using the uncertainty principle of the micro-local analysis, 
the authors obtained C°° regularity for the weak solution of the linear spatially 
inhomogeneous Boltzmann equation without an angular cutoff. 

On the other hand, in [T3], the existence and the C°° regularity have been 
proved for the solutions of the Cauchy problem for linear and semi-linear equations 
associated with the kinetic operators (jl.ip . In this paper, we shall consider the 
Gevrey regularity for such problems. 

Let us first recall the definition for the functions in the Gevery class. Let U be 
an open subset of R d and 1 < s < +00, we say that / <E G S (U) if / £ C°°(U) and 
for any compact subset K of U, there exists a constant (say Gevrey constant of /) 
C = Ck, depending only on K and /, such that for all multi-indices a £ N d , 

(1-2) \\d a f\\ L - (K) < C£ l+1 (a!)*- 

If W is a closed subset of R d , G S (W) denote the restriction of G S (W) on W where 
W is an open neighborhood of W. The condition (11.21) is equivalent to the following 
estimate (e.g. see [6] or [18]): 

\\d a f\\mK)<c^ +1 (\ a \\y. 

We say that an operator P is G s hypoelliptic in U if u £ T>'(U) and Pu 6 
G 3 (U), then it follows that u £ G S (U). Likewise, we say that the operator P is C°° 
hypoelliptic in U if u £ V'{U) and Pu £ C°°(U), then it follows that u £ C°°(U). 

In [T5], Morimoto-Xu proved that the operator (1.1) is C°° hypoelliptic if 1/3 < 
a < 1. Our first main result of this paper is the following: 

Theorem 1.1. Let < a < 1 and 5 = max{|, ^ — Then the operator V 
given by M.l\) is G s hypoelliptic in R 2n+1 for any s > | , provided the coefficient 
a(t, x, v) £ G s {M. 2n+1 ) and a(t, x, v) > 0. 

Compared with what is obtained in [15] , the result of Theorem 1.1 implies that 
the operator (1.1) is also C°° hypoelliptic in the case of < a < 1/3. 
Next, we consider the following semi-linear equation: 

(1.3) d t u + v ■ V x u + a(-A v ) a u = F(t, x, v; u) 

where F is a nonlinear function of the real variables (t, x, v, q). The following is the 
second main result of the paper, which implies that the weak solution of equation 
(1.3) has Gevrey regularity: 

Theorem 1.2. Let < a < 1 and S = max{|, ^ — i}. Suppose that u £ 
L~ C (K 2 ™ +1 ) is a weak solution of Equation [JJfy. Then u £ G 5 '(R 2n+1 ) for any 
s > I , provided that the coefficient a £ G s (M. 2n+1 ), a(t,x,v) > and the nonlinear 
function F(t,x,v,q) £ G s (M 2n+2 ). 

Remark 1.1. Our results here are local interior regularity results. This implies 
that if there exists a weak solution in V , then the solution is in Gevrey class in 
the interior of the domain. Thus, the interior regularity of a weak solution does 
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not depend much on the regularity of the initial Cauchy data. Also, without loss of 
generality, we can assume that Cq 1 < a(t, x, v) < Co for all (t, x, v) G R 2 ™ +1 with Co 
a positive constant, and all derivatives of the coefficient a are bounded in R 2n+1 . 

The paper is organized as follows: in section [5J we prove that V is subelliptic 
by using the method of subelliptic multiplier developed by J. Kohn [14] ■ Section [3] 
is devoted to the study of the commutator of (—A v ) cr with the cut-off function in 
the v variable. In section 01 we use the subelliptic estimates to prove the Gevrey 
hypoellipticity of the operator V . Section [5] is devoted to the proof of the Gevrey 
regularity for the weak solution of the semilinear kinetic equation (1.3). 

2. Subelliptic estimates 

In this paper, the notation, || • \\ K ,n G R, is used for the classical Sobolev norm 
in P K (R 2n+1 ), and (/, g) is the inner product of f,g G L 2 (R 2n+1 ). Moreover if 
/, g e C£°(R 2n+1 ), it is easy to see that 

(2-1) |(/, g)\<\\fUg\\_ K < S l^ + ^. 

We have also the interpolation inequality in Sobolev space: For any e > and 

ri < r 2 < r 3 , 

(2-2) \\f\\r 2 <s\\f\\ r3 +S-^-^/^-^\\f\\ ri . 

Let fl be an open subset of R 2n+1 and S m (il), m G R, be the symbol space of the 
classical pseudo-differential operators (when there is no risk to cause the confusion, 
we will simply write S rn for S m (ti)). We say P = P(t,x,v,D t ,D x ,D v ) G Op(S' m ) 
to be a pseudo-differential operator of order to, if its symbol p(t, x, v; r, £, rf) G S m . 
If P G Op(5 m ), then P is a continuous operator from H^(ft) to Hg~ m (Q,), where 
H^(il) is the subspace of H K (R 2n+1 ) which consists of the distributions having 
their compact support in ft. iJ i "~ m (f2) consists of the distributions h such that 
(j)h G H K - m (R 2n+1 ) for any <j) G For more details on the pseudo-differential 

operators, we refer to Treves [T5]. Observe that if Pi G Op(S' mi ), P 2 G Op(S' m2 ), 
then [Pi, P 2 ] G Op(S ,mi+m2 - 1 ). 

We study now the operator V given by (jl.ip . For simplicity, we introduce the 
following notations 

AS = (-A )*, X = d t + vd x , Xj = d Vj ,j = 1,--- ,n, 

A K = (l + \D t \ 2 + \D x \ 2 + \D v \ 2 )^ 2 . 

Then V can be written as V = Xo + a(t, x, v)K 2a , and d Xj — [Xj, Xq\. The following 
simple fact is used frequently: For any compact K C R 2n+1 and r > 0, there exists 
Ck.t > such that for any / G C$°(K), 

(2-3) \\Kf\\ r <C K , r {\\Vf\\ r +\\f\\ r }. 
In fact, a simple computation gives that 
|K/|| 2 = Re(Vf, a-Wf) ~ Re(X f, a^A^f) 

= Re(Vf, a-'K^f) - [a^A 2 '', X ]f) - [A 2r , a" 1 ] X f) 

< C K ,r{\\Vf\\r+\\f\\r}, 
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where Xq = dt + i/j(v)v ■ d x and ip € Cg°(R™) is a cutoff function in the v variable 
such that tp = 1 in the projection of K on R". Remark that, with the choice of 
such a cutoff function, we have that 

X P(t, x, v, D t , D x , D v )f = X P(t, x, v, D U D X1 D v )f 

for any / £ C£°(K) and any partial differential operator P(t, x, v, Dt, D x , D v ). 

First we show V is a subelliptic operator on R 2,l+1 with a gain of order 5 = 
max{f, §-!}. 

Proposition 2.1. Let K be a compact subset o/R 2n+1 . For any r > 0, i/iere exists 
a constant Cx.n depending only on K and r, such that for any f £ C£°(K), 

(2-4) \\f\\r + S <C K ,r{ ||P/||r + ||/||o }, 

where S = max { j , § — | } • 

In order to prove Proposition 12. 1[ we need the following two lemmas. 

Lemma 2.2. Let K be any compact subset o/R 2n+1 . Then for any f £ Cfi°(K), 
we have 

(2.5) IIA-^Xo/Ho < C K ( r/||o + ||/||o ), 
and 

(2.6) ||A- 1 X,/|| ct <Ck( HP/llo+ll/llo ), J = 1, ■•■,n. 

This is the result of Proposition 3.1 in [15]. The following lemma is to estimate 
the commutators, which is different from the calculation in |15] for the second part 
of the lemma. 

Lemma 2.3. Let K be a compact subset o/R 2n+1 . Then for any f G C^°(K), we 
have 

(2.7) || [X,-, A- 1 X ]/|| (t/2 _ 1/6 <Ck( \\Vf\\ +\\f\\ ), i = l,-..,n, 
and 

(2.8) Ao]/|| CT /4 < Cx( r/||o + ||/||o ), J = l,---,n. 

Proof. We denote Qj = A a ~ 1 / 3 ~ 1 [Xj,X ] = A a ~ 1 / 3 ~ 1 d Xj 6 Op(S" 7 - 1 / 3 ). Note that 
[X fe , Qj] = for any 1 < k < n. Therefore for any / e Cg°(K), 

\\[Xj, A- 1 X ]/|| 2 r/2 _ 1/6 = ||[X i , A-^ol/ll^/a-i/e 

< K^A- 1 ^/, <&/)! + KA-^oX,-/, Qj/)| 
^KA^Xq/, Q^/)| + |(X,-/, XqA-^j/)! 

< IIA-^o/lla/sllQiAi/H-a/a + K^/, [X , A _1 Qj]/)| + \(Xjf, A^QjXof)] 
<C K { IIA-^Xo/^ + IIA-^/l^ + ll/ll 2 }, 

where we have used the simple fact that [Xq, A~ 1 Q j ] E Op(S" T_1/3_1 ). Then ([23)1 
and (|2.6p give immediately (|2.7I) . 

We now study (|2.8|) . First of all, we have 

lltA" 1 ^-, Xo]/||» /4 = (A-'XjXQf, A^A-'Xj, X ]f) 

-(XoA^Xjf, A^/^A^Xj, X ]f). 
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By a straightforward calculation, it follows that 

KXoA-%-/, A a ^ 2 [A~ 1 X j , X ]f)\ = KA-'Xjf, IqA^IA- 1 ^-, X ]f)\ 

< KA-'Xjf, A^^A-'X,, Xojlo^l + KA- 1 ^/, [A^IA- 1 ^-, X ], X ]f)\ 
<C K { \(A~ l Xjf, A CT / 2 [A-%, A ]Ao/)| + ||A-%/||2 /2 + ||/||2 } 

< C K { KA-%-/, A^A^A,, A ]A /)| + + \\f\\ 2 }. 

In the last inequality, we have used (|2.6[) in Lemma 12.21 

Denote P a/2 = A <7 / 2 [A- 1 X j , A ] € Op(S" CT / 2 ). Recall that A = V - aA 2(T . We 
have 

|(A-%-/, A^A^A,, X ]A /)| = |(A _1 Xj/, P CT / 2 X /)| 

< K A_1 ^j7 5 P^/JI + KA- 1 ^-/, P CT/2 aA 2 , CT /)| 

< C K { WA-'Xjff^ + WVfWl+KKA-'X.f, A-°P a/2 aAl°f)\ } 

< C K { ||A-%/|| 2 /2 + \\Vf\\l + [KA-^/H'/a + IK/H 2 } 

< c K { IKA^a-^/u 2 + hp/11 2 , + ii/n 2 }. 

For the last inequality, we used results from (|2.3p and (|2.6I) . Clearly, [A£, A -1 A.,-] = 
[A£, A CT / 2 ] = [A" 1 ^, A CT / 2 ] = 0. Then we get 

WKA^A-'XjfWl = -Re(Vf, a- 1 A CT A- 2 X|/)+Re(X /, aT 1 K" K~ 2 f) 
<Ck{ \Wf\\l+\\A- l X J f\\l+ 1 -\{f : [A CT A- 2 A 2 , a- 1 ^]/)! 

+ [a-\ A ]A CT A- 2 A 2 /)| } 

<C*{ ||7>/ll2 +||/|| 2 1 + ||A- 1 X,-/|| 2 r + |(/, A-^-IA-A- 1 ^-, a" 1 *,]/)! 

<<m r/ii^ + iiA-^/ii^ + ii/n 2 } 

The above three estimates show immediately 

KAoA-%-/, P*/ 2 f)\<C K { \\Vf\\l+\\f\\ 2 }. 
Similarly, we can prove 

KA-^aV, P„,2f)\ < c K { \\rf\\l + \\f\\l }■ 

This completes the proof of Lemma 12.31 □ 
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n 

Proof of Proposition \2.1\ Notice that d x . = [Xj , Xo] and <9 t — Xq — v j ' 

i=i 

[Xj, Xq\. Hence, for any / G C^(K), we have 

n n 

11/11' = \\d t f\\U + £ H^/llS-i + E + ll/llo 

3=1 3=1 

n 

< { IIA^Xo/H? + £ *o]/||?_i 
3=1 

Xol/Hti + IIA-^/l^ + ll/llg }• 

Since <5 = max{cr/4, a/2-1/6} < min{2/3, a} , applying (|2"3|) and ([515]) to 
Lemma [521 we have that 

n 

HA-^o/Hi + £ IIA-^/H* < C K { HP/Ho + ll/llo } 

3=1 

and 

U^M*,, X ]f\\s-i < C K {[[[Xj, X ]/[[*-i + H/llo}. 

It remains to treat the term \\[Xj, Xo]/||<s_i. We consider the following two cases. 

Case (i). 5 = max{cr/4, cr/2 - 1/6} = a/2 - 1/6. 
We apply (|2~71) in Lemma [231 to get 

lift-, Xq]/|| 5 _i < A-^/lltf + llfJO, A-^Xo/IU 

< ^{irao + IIA-^o/IU + H/Hg}. 

Since <5 < 2/3, then applying (|2.5I) again, we get immediately 

lift-, Mf\\ s ^<c K { ||7V||o + H/llo }• 

Case (ii). 6 = max(cr/4, cr/2 - 1/6) = a/4. 
By (|2.8[) in Lemma |2.3[ it follows that 

||[^, *o]/||*-i < || [A" 1 JO, Xol/lk + IIA" 1 , Xo^/IU 

< Cfr{ ||P/||o + ||A- 1 X J -/|| a + ||/|| }. 

Note that 5 < a, and hence from (I2.6[) . we have 

||[^, Xo]/||s_i < C K { \\Vf[[ Q + H/llo }• 
A combination of Case (i) and Case (ii) yields that for 5 — max {cr/4, cr/2 — 1 /6} , 
lift-, *o]/||*-i < C K { \\Vf% + 11/Ho }• 

Then we get 

(2-9) ||/|| 5 <<M HP/Ho + ll/llo}- 
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Choose now a cutoff function ip s Cfi°(M. 2n+1 ) such that x/j\k = 1 and Supp tp 
is a neighborhood of K. Then for any r > 0, e > and / e Cq°(K), by (|2J|) . we 
have 

\\f\\ r+s = \\A r 1>f\\s < IIM7IU + ll[A r > 0/11* < <M HWVIIo + H/llr }■ 
Furthermore, notice that 

[aAf ,M1 = 2o[AJ, M r ]AJ + a[AJ, [A*, ^A r ] ] + [a, ^A r ]A^ ff . 

Hence 

HW/llo < HM^/llo+ll^o, MI/llo + lkK, K,VA''] ]/||o 
+2||a[A£, M r ]A-/|| + ||[a, VA r ]A^/|| 

< c K , r { ii/ii, +iK/n r }, 

Combining with (|2.3I) . we have 

\\Vi?A r f\\a<C K ,r{ WPf\\r+\\f\\r }• 

The above three estimates show that 

\\f\\r+S < CkA ||P/[[r+|l/||r }■ 

Applying the interpolation inequality (|2 . 2[) . it follows that 

H/IU* < C e , r , K { ||p/|| r +||/|| } + £ ||/|| r+5 . 

Taking e small enough, we get the desired subelliptic estimate (|2.4j) . This completes 
the proof of Proposition 12.11 

Since the subelliptic estimate in Proposition 12.11 is true for < a < 1, we can 
now improve the C°°-hypoellipticity result of [15] ( which is for l/3<er< 1 ) as in 
the following Theorem: 

Theorem 2.4. Let < a < 1. Then the operator V given by U.l)) is C°° hypoel- 
liptic in R 2rl+1 , provided that the coefficient a(t,x,v) is in the space C 00 (R 2,l+1 ) 
and a(t, x, v) > . 

In fact, if we consider only the local regularity problem, as in Proposition 4.1 
of [T5j, we can prove that if / e Hf oc (R 2n+1 ),u G r>'(R 2n+1 ) and Vu = f then 
u 6 J ff ; s +' 5 (R 2 ™ +1 ). By using the subelliptic estimate (|2.40 . the estimate for the 
commutators between the operator P and the mollifiers are exactly the same as 
in Section 4 of [15] • This gives the C°° hypoellipticity by the Sobolev embedding 
theorem. The same argument applies to the semidinear equations. 

Remark that the results of [T5] are not only regularity results. The authors also 
proved a global estimate with weights (the moments). This is another important 
problem for the kinetic equation. 

3. Cutoff functions and commutators 

To prove the Gevrey regularity of a solution, we have to prove an uniformly 
iteration estimate (11.21) . Our only tool is the subelliptic estimate (|2.4I) . Since 
it is a local estimate, we have to control the commutators between the operator 
V and the cutoff functions. This is always the technical key step in the Gevrey 
regularity problem. Our additional difficulty comes from the complicated nature of 
the operator V . 
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Since the Gevrey hypoellipticity is a local property, it suffices to show V is Gevrey 
hypoelliptic in the open domain f2 C R 2n+1 given by 

n = n 1 x n 2 = {(t, x) e t 2 + \x\ 2 < 1} x {v e R"; H 2 < 1} . 

Define VF by setting 

W = 2S1 = |i| 2 + |x| 2 < 2 2 , |v| < 2} 

For < p < 1, set Sl p = Sl p x O 2 with Sl p and SI 2 to be given by 

Sl p ={(i,:r)eR n+1 ; (i 2 + |x| 2 ) 1/2 <l-p}, Cl 2 p = {v£R n ; \v\ 2 < 1 - p} . 

Let Xp be the characteristic function of the set SI 2 , and let <f> £ Oq 50 (SI 2 ) be a 
function satisfying < <\> < 1 and J R „ <j)(v)dv = 1. For any e, e > 0, setting 
</> E (f) = e~ n (f) (^) and y E ,e(w) = <j) e /2 * Xe/2+ei v )- Then for a small e, e > 0, 

<p sfi £ C °°(O 2 ); ^, e - = 1 in Sl 2 +£ ~; 

sup |£) a y) e ,g(t;)| < C Q £~ H for any a £ N". 

In the same way, we can find a function ip e ^(t, x) £ C^°(S1|) such that i\i e ^ = 1 in 
f^ +g and sup|D Q Ve,e| < C a £-\ a \. 

Now for any N £ N, TV > 2 and any < p < 1, we set 

$p,N{t,X,v) = ijj p (N-V)p(t,x)(p p (N-1) P (v). 

JV ' N ■ N 

Then we have, 

(3.1) < $p,jv(t,x,u) = 1, {t,x,v)eVt p , 
{ sup\D a <S> p , N \ < C a (N/p)\ a \. 

For such cut-off functions, we have the following Lemma (see Corollary 0.2.2 of 
[TO]). 

Lemma 3.1. There exists a constant C ni depending only on n, such that for any 
< n < n + 2, and f £ S(R n+1 ), we have 

(3.2) \\(D^ p , N ) f\l < C n {(N/p)^ 11/11^ + (JV/p)H+" ||/|| } , | 7 | < 2. 

We study now the commutator of above cutoff function with the operator V. 
Since the operator is a differential operator with respect to the (t, x) variables, it is 
enough to consider the commutator of AJ^ with a cut-off function in the v variable. 
We set (/3 p jv(w) = </?_p (iv-iy (v). The proof of the following Lemma is very similar 

to that of M. Durand [10] . Since our calculus is much easier and much more direct, 
we repeat it here. 

Lemma 3.2. There exists a constant C a . n , depending only on n and a, such that 
for any k with 1 < k < n + 3, and f £ S(R 2n+1 ), 

(3.3) \\[K, <p PtN ]f\\ H < c a . n {{N/pf ll/IU + {N/pT + ° ||/|| } 

and 

(3.4) \\IK, k, Vp M]f\U<c*, n {{N/pf° \\f\\ K + {N/ P T +2 ° \\f\\,} . 
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Then as a consequence of (|3.3[) . we have 

y p , N K(i ~ nM\n < c„, n {(N/pf \\j\\ k + {n/ p t + ° \\f\\ ] . 

Hence, in the following, we omit the detailed discussions for such terms. 

Proof. To simplify the notation, in the course of the proof, we shall use C to denote 
a constant which depend only on n and a and may be different in different contexts. 
We denote by (r, £, 77) the Fourier transformation variable of (i, x, v). J-t, x {g), ^v(g) 
are the partial Fourier transforms, and g is the full Fourier transform with respect 
to {t, x, v). Set 

In the following discussion, we always write H(v) for H T ^(v), if there is no risk of 
causing the confusion. It is clear that 

(3.5) Tu x {K){t,^v) = K, p, 1 j4Ft,*(/)(T,£,tO = [K, <p p ,n]H(v). 

Observe that the desired inequality (|3.3[) will follow if we show that, for each fixed 

pair (t,£), 

(3.6) 

I [K, ^(•)]^0)||^ (R „ ) < C{ (N/pf \\H(-)\\ HH ^ ) + (N/pr^ \\H(.)\\ L2W }. 
Indeed, a direct computation yields that 

\\h\\l = I (l + T 2 + \e + \v\ 2 r\Hr,^v)\ 2 drd^d V 

JR2« + 1 

<C [ (l + r 2 + \er([ (l + \v\T\ h (T,tv)\ 2 dv)dTdt 



= cf (i+r 2 + \er( [k, <p P M-))Hr,d-) H(B ) 



drdS,. 



This along with ()3.6p yields the desired inequality Q3.3p . 

Next, we shall prove ()3.6j) . First, for any g G <S(R"), we have 

(3.7) W 9 (v) = cJ 9 ® 



with Cc being a complex constant depending only on a and the dimension n. 
In fact, 



\V\ Jm n \JR" \v\ 



On the other hand, it is clear that 
1 - e-™-" 



\v\ 7r« It 



dv = \v\ / — du. 



Observe that J Rn 1 du ^ is a complex constant depending only on a and 
the dimension n, but independent of 77. Then the above two equalities give (|3.7[) . 
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Next, we use (|3.7[) to get 



H(v)(p p ^ N (v) - H(v - v)ip PjN (v - v) 



v\ 



dv 



= V p ,n(v)\D v \° H{v) + C a 
which gives that 

(3.8) [\D V \", i Pp , N (v)]H(v) = C (T 



H(v - v)((p PiN (v) - (P p< n(v - v)) 



\v\ 



dv, 



H(v - v)(ip p>N (v) - <p p ,n(v - v)) 



dv. 



Let Xp/N be the characteristic function of the set {v; \v\ < p/N} . By the above 
expression, we compute 

2 



\D V \°, <p p , N ]H\\ 



) 



\C a 



H(v - v)((p Pt ff(v) - p p ,n(v - v)) 



I -iii+ij 



dv 



dv 



< 2\C„ 



X p /n(v)H(v - v)(ip p>N (v) - <p p ,n(v - v)) 



dv 



dv 



+ 2\C a \ 2 
< C(sup \d v <p p ,n\) 



(l - X p /n(v)) H(v - v)(<p p>N (v) - <p p m{v - v)) 



I - in+o- 



dv 



dv 



X p /n{v) \H(v - v)\ 

i ~ i n+o - — 1 

M 



dv dv 



+ C(sup \tpp, 



N 



(1-X p /n(v))\H(v-v)\ 



dv dv 



=: A\ + A 2 , 

For the term Ai, Young's inequality for convolutions gives 



X p /n(v) \H(v - v)\ 

I - I n+cr— 1 

\v\ 



dv) dv < \\H\\ 2 L2(mi]) 



X p /n{v) 



\n-\-a— 1 



L 1 (R„) 



Then (|3.1|i with \a\ = 1 and the following inequality 



X p /n(v) 



in+CT — 1 



L 1 (R„) 



2(l-<7) 



deduce that 



4i<c(iv/p) a *||ff|£ 2(R?) 



Similarly, we can use (|3 . 1 [) with |a| = and the inequality 

(1-X p /n(v))\H(v-v)\ 



\v\ n+(T 



1-X p /n(v) 



to get 



dvj dv < \\H\\ L2{Mv) 

<C(p/N)- 2 °\\H\\ 2 LHMv) 

A 2 <C(N/p) 2 °\\H\\ 2 L2 ^ y 
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On the other hand, it is trivial to see 

\\[(\D V \° -A°) , ip p , N ]H\\ L . {K) <C\\H\\ L ^ y 
Now we combine these inequalities to conclude 
(3-9) || [K, v p , N ] H |U 2(K n) < C {N/pf \\H\\ L2m . 

Next we treat ||[A^, (f p .N]H\\H^(m^)- Similar to the above argument, we study 
only the commutator || [|D„| cr , (Pp,n]H\\h"(r^)- First, we consider the case when k 
is a positive integer. Let a be an arbitrary multi-index with |a| < k. Then taking 
derivatives in (I3.8[) . and then using Leibnitz's formula; we get 

a? (Oat, tp. PtN (v)]H(v)) 

= Crr y c ef (d*H(v - v)) ■ (dr p ^ P .N(v) - <PrMv - v))) ^ 
Thus similar arguments as above show that 



^([lAT, p PiN (v)]H(v))\\ < C7]T (iV/p) |Q ^ l+ff \\%H\ 



L 2 (RJ) 



f3<a 

Together with the interpolation inequality (|2 . 2[) . we obtain 
\\dZ([\D v \°, <p p , N (v)]H(v))\\ L2(K) 

<c{{N/pT \\H\\ h ^ + {N/pp + ° \\H\\ L2{K) } . 

Since a, \a\ < k, is arbitrary, we conclude 

|| [ \D V \° , tp P , N (v)]H(v)\\ HHK) < c{{N/pY \\H\\ Hfim + (N/p) K+a \\H\\ L , {n) } . 

This implies (|3.6[) . when k is a positive integer. 

Now we consider the case when n is not a integer. Without loss of generality, we 
may assume < k < 1. Write k + a = 1 + p. Then < p < 1, and 

[\D v \ K+a , y p , N {v)]H{v) l2( ^ < \\[\D v f, <P Pi n(v)] h {v)\\ h1(k) 

'_\D V \\ <p p , N (v)] \DXH(v) 
We have treated the first term on the right, that is, 

|| [ \D v f , cp PiN (v)]H(v)\\ Him < c{(N/pf \\H\\ h1(K]) + (N/p) 1+ » \\H\\ L2(K) ] . 
On the other hand, one has 

[\D V \\ <p p , N (v)] \DXH(v) <C(N/p)\\H\\ H ^ Rn) . 

Li (Ik.^ ) V 

For the proof of this estimate, we refer to [10] for instance. Hence 

[iA,r +CT , <p PiN (v)]h(v) 



< 



C{ (N/pr\\H\\ H1 < K) + (N/p) 1+ »\\H\\ 
+ (N/p) ||ff IU (R n) }• 



L 2 (18™) 
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L 2 (R") 



Notice that k > 1,. The interpolation inequality (|2.2[) gives 
[\D v \ K+ \ Vp,n(v)]H(v) 

< C{ (N/pf \\H\\ HKm) + (N/pf + ° \\H\\ L2(m }. 
Since < K < 1, then 

||[|A,r, <p p ,n(v)] W H ( v )\\m^) 

< C{ (N/pf \\H\\ H „ (K) + {N/p) K+ ° \\H\\ L2{ ^ } 

< C{ (N/pf \\H\\ HK(K) + (N/pf + ° \\H\\ L2m }. 

In the last inequality, we have used the interpolation inequality (j2.2[) . The above 
two inequalities yield that 



< 



\D V \ K [W , <P p ,n(v)]H(v)\ 
(p p , N (v)]H(v) 



L 2 (RJ) 



I K~\-a 



Hence 



+ || [ \ D v\ K , Pp,n(v)] \D v \° H(v)\\ l2(k) 

< C{ (N/pf \\H\\ HHK) + (iV/p) K+ff \\H \\ L2{K) }. 

llfl^T, ¥J /9 , JV -(u)]F(«)|| Hre(R „ ) 

< C{ \\\D V \ K [\D v \ a , ^ p , N (v)]H(v)\\ L2(m 
+ \\[\Dv\ a , tp P ,N(v)]H(v)\\ L2{K) } 

< C{ (N/pf \\H\\ HHK) + (N/pY + ° || l2(r „) }. 

This implies (|3.6[) for general k, 1 < k < n+2, and thus (|3 . 3|) follows. The inequality 
can be handled quite similarly. Thus the proof of Lemma 13.21 is complete. 

□ 



4. Gevrey regularity of linear operators 

In this section, we prove the Gevrey hypoellipticity of V . We will follow the idea 
of M.Durand [10]. We consider the following linear equation 

(4.1) Pu = d t u + vd x u + a(t,x,v)(-A v ) a u = /, ((,i,i))elxl"xR", 

where < a < 1. From Theorem 1 2. 4[ any weak solution of the above equation is 
in C 00 (R 2 " +1 ) if / G C°°(R 2n+1 ) . Hence, we start from a C°° solution, and prove 
the Gevrey hypoellipticity in the following proposition, where fl and W = 2f2 are 
open domains of K 2n+1 defined in the section [3] 

Proposition 4.1. Set S = max{j, § — and let s > |. Suppose the coefficient 
a(t,x,v) G G s {n),a > 0, and u G C°°(W) be such that Vu = f G G s {n). Then 
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there exits a constant L such that for any r G [0, 1] and any N G N, N > 4, 

\\$ PtN D«u\\ r+n+1 + \\$ p , N A°D<*u\\ r _ i+n+1 

< p( . + „)(| n |-3) ((|os|-3)lJ 

ZioZds /or any a G N 2n+1 , |a| = N and any < p < 1. _ffere and in i/ie sequel we 
denote A CT = A£ = (— A„)5 /or simplification. 

Remark 4.1. Here the Gevrey constant L of u is determined by the Gevrey con- 
stants B a and Bf of the functions a, / G G"(fi), and depends only on s, cr, n, ||tt||#n+a(w) 
and ||a|| C 2n+2(f2) ■ This can be seen in the proof of Lemma I4.3[ Lemma 14.41 and 
Lemma [LSI . 



As an immediate consequence of the above proposition, we have 
Proposition 4.2. Under the same assumption as in Proposition ^. 1\ we have u G 

G s (n). 

Indeed, for any compact subset K of f2, we have K C fl Po for some po, < po < 
1. Then for any a G N 2n+1 , \a\ = N > 4, (E) . N gives 

\\D<*u\\ LHK ) < \\$ Po , N D<*u\\ n+1 < ^hZ-v ((M ~ 3)!) S < (^) H (H!) S . 

Taking = pn f+ n + Mlc 4 (A') ' tncn f° r au a ' 

The conclusion of Proposition 14.21 follows . 



Proof of Proposition We prove the esitimate {E) t ^n by induction on N . 

In the proof, we use C n to denote constants which depend only on n, which may 
be different in different contexts. Let $ be an arbitrary fixed function compactly 
supported in W such that $ = 1 in O. First, we prove the first step of the induction 
for N — 4. For all \a\ = 4, we use (|3 . 2[) in Lemma \3. II to compute 

||<J> p , 3 I} a u||r + n+i + \\<S> P , 3 A a D a u\\ r _, 2+n+1 

< C n {||*D«u|| r+n+1 + ||*A'D««|| r _ 4+n+1 } , 

On the other hand , since \a\ = 4, 

\\$D a u\\ r+n+1 + \\^A a D a u\\ r _s +n+1 < C n \\u\\ Hn+HW) . 

The term on the left side is bounded by the smoothness of u. Combing these, we 
obtain 

(E) rA \\<P p , 3 D a u\\ r+n+1 + \\$ p , 3 A°D a u\\ r _ i+n+1 < g^MggfW < 

Thus (E) ri i is true if we take L > C n \\v,\\gn+e(an + 1. Let now N > 4 and assume 
that (E) ri N-i holds for any r G [0, 1]. We need to show (E) r ^ still holds with a 
constant L independents of N or r G [0, 1]. We denote 

\\Diu\\ r = ]T ||D^|| r . 
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In the following discussion, we fix N. For each < p < 1, define p = ^r-p, p — 
N ~ 2 p. Let & p ,n be the cutoff function constructed in the previous section which 
satisfies the property (|3.1[) . The following fact will be used frequently, for k = 
1,2,- •• ,N with N > 4, 



(4.2) 



1 1 1 

< —, rr- < 



1 



p(s+n)k — p(s+n)k — z(s+n)k p(s+n)k V jy _ 2 



N ,(s+n)k ^ 36 s+n 

X < 

V AT _ 1 / 



p(s+n)k ' 



We shall proceed to prove the truth of (E) r ^ by the following four lemmas. 
The first one is a technical lemma, and the second lemma is devoted to the proof 
of the truth of (-E) r ,iV for r = 0. In the third one, we prove that holds for 

< r < |, and in the last one we prove that (E) ri jy holds for all r with < r < 1. 

Lemma 4.3. Let s > 3 be a given real number and k > 5 be any given integer. 
Assume the estimate (-E)o,m holds, i.e. 



(4.3) 



\^ P , m D^u\\ n+1 



hn+l p 



j m— 1 

- -^ ((^- 3 )0' 



(s+n)(m— 3) 



ZioWs /or a/Z 7 with \ j\ = m < k, and all < p < 1. TTien if L > 4™ +3 (||u|| ii -„ +6( - V j / - ) + 
1), one /ias, /or aZ/ /3 wrei/i |/3| = k, 



(4.4) (*/p)»^ ||$, jfc i^u|| + (k/p) 



n+3 



< 
o p 



(s+n)(fc-3) 



=57((*-3)0' 



Proof. Without loss of generality, we may assume k > n + 4, for, otherwise, in the 
case when 5 < fc < n + 4, it is obvious that for all (3 with \(3\ — k < n + 4, 



(fc//7)™+ 3 ||$ p ,fc^u|| + (fc/p)' M 



< (1/p) ( S+ n)( fc -3) 2 („+3) fc || U || w) 



Then the desired inequality (|4~4l) follows if i > 4™+ 3 



Now for all (3,\(3\ = k > n + 4, we can find a multi-index (3 < (3 such that 
|/3| = n + 1. First we treat (k/p) n+3 \\^ P}k D^u\\ „. Since , . = 1 in 

k ' 

Supp$p 5 fe, then the following relation is clear: 



Observe 



$ , fc D p $ (fc -i) 



< 



n+1 



k — n — 1, then we use the above relation and the assumption 

I), 



HOD to compute, for X > 4™+ 3 (JM| H „ +6(H/) 

(fc/pr+ 3 ll$ )P , fc D^ii < (fc/p) n+3 



ri+l 



< (k/p) 



n+3 



fc-n-2 



< 



p(s+n)(fc-n-4) 



1 r k - 2 
<l < ((fc-3)!) 



((fc-n-4)!) f 



2 p(«+n)(fc-3) 
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In the same way, we can get the estimate on the term (k/p) n+3 
that is, 



(k/ P ) 



n+3 



i rk-2 



~ 2 p( s +™)( fc -3) 



Thus by the above two inequalities, we get the desired inequality (j4.4[) . This com- 
pletes the proof. □ 



Lemma 4.4. Assume that (E) r _ N _ 1 is true for any r £ [0, 1]. Then there exists a 
constant C±, depending only on the Gevrey index s and the dimension n, such that, 



ifL>4^(\\ U \\ H , 



+ 



(W) 



1 



(4.5) \\$ p , N D<*u\\ n+1 + \\^ p , N K a D a u\\_ i+n+1 < p ^ al l 3) ((\a\ - 3)!) s 
for any a G N 2n+1 , |a| = N, and any < p < 1. 

Remark 4.2. In fact, this is (E) r ^]sr for r = if we choose L such that L > C\ 
andL>4»+ 3 (|M| ffIl+fW) + l). 



Proof. We choose a multi- index /3 with |a| = |/3| + 1. Then |/3| = N — 1. Recall 
p = ^j^P- By the construction, & Pi n-i = 1 in Supp^Ar. Thus 



\\<S> P , N D a u\\ n+1 < \\^ p<N D^u\\ 1+n+1 + \\{D^ p . N )D^u\\ n+1 

< \\$ P , N $p,N-iDPu\\i +n+ i + ||(£)$ P!jv )$p,Ar-i^u||„ + i 

< C n {||$ p -, A r_ 1 i}< 3 u || 1+ „ +1 + (N/p)\\<f> PtN _ 1 DP U \\ n+1 + {N/p) n+ ^\\^ N ^D^u\\ } 

In the last inequality, we have used Lemma [3.1l For the third term on the right-hand 
side, we use Lemma l4~3l with k = N — 1 to obtain 

M _ 1 f / AT _ 1 \ n + 2 I 

(JV// J ) B + a ||$ AW _ 1 D^||o - — — I ( J ||^-i^«||o f 

AT-1 f /jV-l\ n+3 „ fl ,, 1 

<— {(— ) ll^-i^llo] 

^ p ^+^-4) ((^-4)0 
Applying the relation (|4.2[) . we get 

Of)s+n r q| — 2 

(JV/^H^-^Ho < p(s+w)(H _ 3) ((H - 3)!) f 
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On the other hand, by the induction assumption that (E) r< N-i holds for any r 
with < r < 1, we have immediately 

||$p, N _ 1 i}' 3 u|| 1+ , i+1 + (N/p)\\$ p , N -iD f, u\\ n+1 



< 



WYWW + Wp) ~, s+n)m _ 3) ((III - 3)!)' 



Thus 



p(s+n)(m-3) Win »>•) \"it>) 1 ^'"'^{«+n)(|?|-3) 
or|<*|-2 

^ ^ + n)(H-3) ((H- 3 )0'W^-3))' 
ons+n r lal— 2 

<£L_J_^((| a |_ 3 )!) s . 

— p(8+n)(|a|-3) v vl 1 y / 



IIW«IUi< ((H-3)!)' 



By exactly the same calculation, we obtain 

||*p,*A*Z?" u ||_ 4+n+1 < _ pT - y ^__((| a |- 3 )!) s . 

Taking C\ — 60 s+n C n with C n being the constant appearing in Lemma I3.1[ we 
obtain (14.5[) . This completes the proof of Lemma [4~4l 

□ 

Lemma 4.5. Assume that {E) Tt tj—\ is true for any r £ [0,1]. Then there exists 
a constant C2, depending only on a, the Gevrey index s, the dimension n and 
IMIff"+6(iv) > IMIc™+ 2 (o) > such that f or any < r < ^, if 

L > max{2 s+1 B a , B f , 4"+ 3 (\\u\\ Hn+6{w) + l) } 

with B a ,Bf being the Gevrey constants of a, f G G s (fi), we have that 
(4-6) ^ 

||$,, Ar ^ u || r+n+1 + ||* P)JV A'D a «|| r _j +B+1 < (^^,,3) ((N - 3)!) s (7V/p)^, 
/orani/aeN 2 " +1 , \a\ = N . 

Remark 4.3. The assumption that L > 2 s+1 B a will be needed in Step 2 of the 
following proof of this lemma, while that L > Bf will be required in Step 3. That 

l, > 4»+3 ^||m|| h „ +6 ^ + 1^ is required because in the sequel we will use frequently 

the conclusion of Lemma 14.31 where such a assumption is presented. 

Proof. In this proof, we shall use Cj,j > 0, to denote different constants which 
are greater than 1 and depend only on s,a,n, ||«||jy n +6(wr) an d ll a llc 2n + 3 (n) ■ The 
conclusion will follow if we prove that 

(4.7) \\$ P , N D a u\\ i+n+1 + \\$ p , N A°D<*u\\ n+1 < p ^^_ 3) ((\a\-3)\) s (N/p)^. 

Indeed, from (j4~7]) we know that (f4~6|) is true for r = f . The truth of (|4.6p for the 
general r, < r < | , follows from the interpolation inequality (|2.2p and Lemma 
Ol 

To prove Q4.7[) . we shall proceed in the following four steps. 
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Step 1. In this step we prove 
(4.8) \\a[l 2 °, ^jyl^HU 



+n+l 



Recall $ Pi Ar(i, x, v) — ip p jj(t,x)(p Pt ]y(v) with V'p.JV > fp,N being the cut-off func- 
tions constructed in Section 3. First, notice that ip Pt N = 1 in the support of ip Py N, 
and tfp^N = 1 in the support of ip p .N- It then follows that 



|a[A 2CT , <P p , N D a }u\\_t 



-n+l 



||a[A 2ff , <p p , N }^ P ,ND a u\\_s 



+n+l 



<a 



a {\\[A a , cp p , N }i> p , N A°D a u\\_s +n+1 + \\[A°, [A°, <f P ,N]Wp,ND a u\\_ i+n+1 } 
<C Q {||[A CT , ^ p ^ p 

,JV ^p,JV <Pp, N A cr D a u\\_s +n+1 

+ ||[A CT , [A CT , (p p , N }]^ p , N tpp, N (Pp, N D a u\\_s +n+1 ^ 

= C a {||[A CT , tp PiN ]^ PtN ^ >N A"D a u\\_ i+n+l 

+ \\[A°, [A CT , ^]]Vp, W $p,7v^ Q «||_| + „ +1 } 
=: (Si) + (S 2 ), 

where C a is a constants depending only on the coefficient a through ||o||cn+2(n) • 
To estimate the term (Si), we apply the inequality p.3[) in Lemma 13.21 and then 
(|3.2p in Lemma l3~T1 This gives 



(Si) < C Q C CT ,n{ Wpf 
+ (JV/P) 
<G a G A{NlpY 



^p,JV$p : ArA CT D a U 



ra+l-f +a 



-f+n+1 
c n«. 



„} 



First, the estimate (14.51) in Lemma 



-p,iV-< 



yields 



(Si) < CaCo-^nCi 



iV 



L|a|-2 



< 



( S+ „)(| Q |_ 3 ) 



p / ( o(*+«)(l a l- 3 ) 
((|a|-3)!)*(? 



((N-3)!) ( 



P^ 

In the last inequality, we used the fact 4f > 1 > c- Next, we treat (Si) . By virtue 



of the induction assumption, the required condition (I4.3[) in Lemma 
with k — N. It thus follows from (14.41) that 

LM-2 



is satished 



(Si) < C a C a ^ n 



< 



N 
P 

C 2 L^- 2 

,(s+n)(|a|-3) 



P 



(s+n){\a\-3) 



((H-3)!)* 



((|a|-3)!) f 



Thus 



(a)s^Rf«M-3)0'(7 
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Now it remain to treat the term (&). By the similar arguments as above, the 
inequality (|3.4[) in Lemma l3~2l gives 



(ft) < C A (N/pY a \\^p, N D a u\\_s +n+1 + C 4 (N/p) n+L -^ a \\<f>p, N D a u\\ := M +Af 2 . 

We first estimate Af\. Choose a multi- index j3 with \a\ = |/3| + 1. Then the similar 
arguments as the proof of Lemma 14.41 give 



\\$r, N D<*u\\_ i+n+1 < O l {||$= jJV _ 1 ^ti|| (1 _ 4)+n+1 

+ Wp)ll*|, W -i^ll-f + „ + i + (JV/p) B+M ^D^Ho}. 
We recall p = ^ N \p p ■ By the interpolation inequality (|2.2j) , 



Wp)II^-1^II-1 + „ + 1 < l]^-l^^]](l-|) + n + l + [-) \\^,N-l D ^h}- 
Therefore 

\\<S>r, N D a u\\_s +n+1 < 0.{||^ jJV _ 1 I>^u|| (1 _ 4)+n+1 + (JV/p)»+ a -4 H^^x^ullo} 
Hence TVi < Afx,i + A/1,2 with A/i,,i, A/i^ given by 

Since (S) r .jv-i holds for all r e [0, 1], then it follows that 

~ / m\ 2<t r\ a \- 2 f n i\ s ( 1_ 2) 



£(»+n)(H-4) - \p 



- 6 ( T ) ,( S+ n)( H -4) ((l"|- 4 ) ! ) 



^( 7 ) p ( S+ n)(| a |-3) (^i- 3 )0' 



In the last inequality, we used again the fact 4p > cr. For the term A/1,2, we use 
Lemma 14.31 with fc = N — 1 . This gives 



M^<Cb(^-) ( — ) {(—=-) ll^-i^llo 



N _l\ -!-3+ 2ct riV-3 



Since — 1 — | + 2er<s, then it follows from the above inequality that 

^ 2 ^^S£)((h-3)o s - 



With the estimate on Afi 1 , one has 



ft j \a\— 2 / N\ 

m =m,2+m,2 < p(s :„ )(H - 3) ((H-3)!r ( 7 ) 
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In the following, we treat Af 2 = C 4 (N/ p) n+1 ~^ +2,J \\<S> p , N D a u\\ Q . Using Lemma 
with k = N, we get 

M<a 7 (- ( T ) nwi. 



~ //V\' T L^~ 2 
"^((H-3)0 (j-J 



(3 ( S +n)(|Q|-3) 

Thus, 



p r|a|-2 / 

(5 2 )=M+AA 2 < ^ )(H _ 3) ((H-3)!) S ^ 



With the estimate on (Si), we get the desired inequality (|4.8[) . This completes the 
proof of Step 1. 

Step 2. In this step, we prove 

(4.9) \\[v, <fr P ,^>ii_ l+w+x < p ^m-s) - m'wp)*- 

Recall V = Xq + ak 2a with Xq — dt+v -d x . Then a direct computation deduces 
that 

\\[P, $ P ,ND a ]u\\_ i+n+1 < \\[X , $ P , N D a ]u\\_ i+n+1 + \\a[l 2 °, <S> p , N D a ]u\\_ i+n+1 

+ \\$ P ,N[a, D a ]A 2 ^u\\_s +n+1 
=: (I) + (II) + (III). 

We have already handled the second term in Step 1. It remains to treat the first 
term (J) and the third term (III)- 

Observe that [Xq, D a ] equals to or D a ° for some ao with |ao| < |a|. A direct 
verification yields 

(I) < ||[X , $ p , N ]D a u\\ n+ i + [\$ p , N D a °u[[ n+1 

< \\{D^ PiN )^ PiN D a u\\ n+1 + \\$ p>N D a °u\[ n+1 

< C n [ (N/p)\\$- p , N D a u[[ n+1 + (N/p) n+2 \\$ P!N D a u\\ + [\$ p , N D a °u\\ n+1 }. 

For the first term and the third term on the right-hand side, using (|4.5j) in Lemma 
I4.41 and noting that 4r > 1, we obtain 

C n { (N/p)\\$p, N D a u\\ n+ i + \\$ p , N D a °u[[ n+1 } 

<c4N/ P +i) ^l^ 2 _ 3) ((\a\-3yy 



c 12 lH- 2 
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On the other hand, we use Lemma T4. 31 with k — N to get 

C n (N/ P r +2 \\^ N D a u\\ < -g|^L ((|al-3)!) s (JV/p)^. 

Thus 

Now it remains to eatimate (III)- The Leibniz' formula yields 
(///) < C2\\$ PtN (Dia)A 2 ' T D a ->* " 

0<|7|<|a| 

(4.10) 



u ll-#+„+i 



<C„ J] ^P^llc^^-P^A^-^IU,^, 

0<|7|<|a| 

where = 7 t7^t^ji are the binomial coefficients. Since a 6 G S (J7), letting £? a be 

the Gevrey constant of Gevrey function a on f2, we have 

(4.11) 

P 7 a|lc^(o)<Si 7hl ((l7|-2)!) S if M>2, ||^a|| c „ +2(n) < S a if | 7 | = 0, 1. 
On the other hand, observe that 

||$ p ,ivA 2 ^ a -^||_ i+n+1 <||[A CT , $ p , N ]l°D a -~<u\\_ i+n+1 

+ \\$ P , N A"D<*-iu\\ (lT _ i)+n+v 
We have handled in Step 1 the first term on the right hand. This gives 

MX*, t^iA-ir^ u]Li+n+l < -g^g^ ((H _ | 7 | _ 3 )!)'wriV. 

For the second term, note that |a| — I7I < N — 1 for 7^0. We use the induction 
hypothesis that {E) Tt N-i holds for all r € [0, 1], to get, for 7, < |7| < \a\ — 3, that 

W^D^u\\ {a -i )+n+ r < p( ^H-M-3) KM " W " 3)0 S Wp) s( ^ f) - 
Observe that 

< (w < 2 ^-i7i-2r + ni 7 i + 2r 

< 16 s (2 s )^ 1 {N -\"f\~2) s p- s , 
Thus for 7 with < \j\ < \a\ — 3 = N — 3, we have 

||$^A*D— u|| ((T _ |)+n+1 < y„ )( | a| _ |7| _ 2) ((|a| - | 7 | - 2)!) s . 

Note that the above inequality still holds for 7 with \j\ = \a\ — 2 if we take L > 
4 n+1 ^HwHjjn+e^) + • Consequently, we combine these inequalities to obtain, for 
0< | 7 | < H-2, 

\\$ p , N A*°D°-"<u\\_ i+n+1 < Cl ff ^^'"' ((lal - | 7 | -2)!) s (N/p)* . 
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This together with (|4.11|) yields 

]T ci \\D^ a \\ Cn+m • 

2<|7|<M-2 



< 



N 



E 

2<H<|a|-2 



l^|!(H-|/3|)! 
( „l ! 2 )((l«|-N- 2 )0 



(2^ a )H^((| 7 |-2)!) f 



< Cl6L ■ ■ (n/ p Y 



p(s+n) (|a|-3) 



E 

2<|7|<|a|-2 



2'B„ 



ItI— i 



|«|!((|«|-4)!)' 



< 



Ci 6 i |Q| - 2 



/) ( s +«)(|q|-3) 



— ((\a\-3)\) s (N/p)^ J2 

2<|7|<|a|-2 



2"B a 
L 



ItI-i 



(|a| -3) 8 - 1 ' 



Observe that s — 1 > 3 and thus the series in the last inequality is bounded from 
above by a constant depending only on n if we take L > 2 s+1 B a . Then we get 



£ CI Wa\\ Cn+2{ ^ ■ 

2<M<M-2 



< 



CvjL 



a -2 



For I7I = 1, |a| — 1 or |a|, we can compute directly 

\y\=X i \ot\ — X,\ot\ 



Combination of the above two inequalities and (|4.10p gives that 

™<^S)((H-3)0 s Wp) f - 



Consequently, the desired inequality (|4.9|) follows. This completes the proof of Step 
2. 

Step 3. In this step, we prove that if Vu = / € G s (Cl) and if £ > B with i? the 
Gevrey constant of /, 



3+™+! - p («l -'.) 



(4.12) \\V® p , N D a u 

Indeed, observe that 
\\V$ p , N D<*u\\_ i+n+l < \\[P, ® P , N D a }u\\_s 



f+ra+1- 



Since Vu = f e G s (ft), then || J D 7 P/|| ff „+2 (0) < B if M < ri + 5, and 
\\D^Vf\\ Hn+2{n) < B^~ 2 ((| 7 | - n - 5)!) s , if |7l > n + 5. 
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Hence, 

\n+2 II 



$ P , N D<*Vu\\_, +n+1 < C n (N/ P r+ 2 \\D a Vf\\ Hn+2m < - 3)!) ; 



We take L such that L > B. Then the above inequality together with (|4.9[) in Step 
2 yields immediately the inequality (|4.12l) . 

Step 4. In the last step we show (|4.7p . And hence the proof of Lemma 14.51 will 
be complete. 

First we apply the subelliptic estimate (|2.4[) . which is needed only here, to get 
\\^ P , N D a u\\s +n+1 < C(n){\\V^> p , N D a u\\_s +n+1 + ||^ )iVj D^|| n+1 } 

with C(Q) a constant depending only on the set tt. Combining Lemma 14.41 with 
(I4TT21 in Step 3, we have 

(4.13) ||* PiAr Z?°u||. +n+1 < ^±^((|a| - 3)!) s (A/p)#. 
Next, we prove 

(4.14) \\* lh sZ*D*«\\ i _ i ^ 1 < ^IkH-3) ((H-3)!) S Wp)^. 
Observe that 

\\<S> P , N A a D a u\\^_^ +n+1 < ||[A CT , <S> p , N ]D a u\\ n+1 + \\A°<Z> p , N D a u\\ n+1 . 

By the same method as that in Step 1, we get the estimate on the first term of the 
right side, that is, 

||[A CT , $ PtN ]D a u\\ n+1 < ^^ ((\ a \-3yy(N/p)f. 

Then it remains to estimate the second term. A direct calculation gives that 
\\A"$ p , N D a u\\l +1 

= Re (V$ p , N D a u, a- 1 k 2n+2 $ p , N D a u) - Re (X <S> p<N D a u, a" 1 A 2n+2 <S> PtN D a u) 
= Re(V$ p , N D a u, a- l k 2n+2 <5> p , N D a u) - ^(<5> p , N D a u, [A 2n+2 , a - l ]X Q $ p , N D a u) 

-^(<S> p , N D a u, [a^A 2n+2 , X^ p , N D a u) 
<C 25 { \\V^ N D a u\\\ +n+1 + \\%, N D a u\\l +n+1 }. 
This along with (14. 12)) and (|4.13p shows at once 



A a $ n . N D 



p ,nU u 



< 



C 26 L^~ 2 



((\a\-3)!) s (N/ P y 



„+l - p (s+n)(\a\-3) 

and hence (|4. 14[) follows if we choose C 23 = C 24 + C 26 . Now by (|4.13|) and (|4. 14[) . 
we obtain the desired inequality (|4.7p if we choose Co = C 22 + C23. This completes 
the proof of Step 4. 

□ 



In quite the similar way as that in the proof of Lemma I4.5[ we can prove by 
induction the following 
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Lemma 4.6. Assume that (E) r .N-i is true for any r £ [0,1], then there exists a 
constant C3, depending only on a,s,n, \\u\\ Hn+f i^ w ^ and \\a\\ c2n+ 2^ , such that for 

any r G [f , 5], if L > max{2 s+1 5 a , B f , 4"+ 3 (\\u\\ Hn+e(w) + l) }, we have, for 
all a, \a\ — N, 

\\^ p , N D a u\\ r+n+1 + \\<S> P , N A a D a u\\ r _s +n+1 < -g^t^((| | - 3)!) S (N/ P y r . 

Inductively, For any m € N smc/i £/ia£ ^ < 1 + |, the above inequality still holds 
for any r with ( m ~^ s < r < and hence for all r with < r < 1. 

Proof. Since the arguments are quite similar as that in the previous lemma, we 
only present here a sketch of the proof. Assuming (E)ms_ N with m > is valid, 
that is, for any a, |a| = N, 

\\<S> P , N D«u\\^ +n+1 + \\<£ P ,NA°D«u\\ <^h + „ +1 < ^' ( n_ 2 3) ((l«|-3)!) S (A/p)^ 

we need to show the validity of (E) 0+1)5 „, and the validity of (E) r n for r 6 

2 > JV 

Il2±lM] can b e obtained by using interpolation inequality (|2.2[) . To get the 
truth of (E) ( m+ i)s M , it suffices to prove 

(4.15) H^,iv^[|^ +n+1 < ff|_ 3 3) ((H - 3)!) s (A/p)^ 



and 



(4.16) |]$ P)J vA^ U || ¥+n+1 < -gL__((| a | -3)!) s (A/p) ; 

First, we repeat the procedure in which (|4.9[) is deduced from the validity of (E)q } n, 
then we use the estimate of (E) ^ N to get 

HP. W>ll<^ +n+1 < ^kh^) ((N- 3 )0 S ™^- 
Similar to the arguments as f|4. 12[) to get 

(4.17) ||W P ,^|^ +1 <^((|a|-3)!) s (iV/p)^. 

This together with the subelliptic estimate 

\\$ n . N D a u\\ (m+ w |w|1 < Cfn){||P$ .^D a u|| (ro -i) < |n|1 + pp.jv^Hn+l}, 

yields the required estimate (I4.15[) . Moreover we can deduce that 

II^A^ull^^ < Czi{\\VS> p , N D a u\\±^ +n+1 + \\<P P , N D a u\\ M+iM +n+1 }. 

In fact we have shown that the above inequality for m = in Step 4 of the proof of 
Lemma 14.51 and the validity of the above inequality for general m can be deduced 
similarly without any additional difficulty. Consequently, the required estimate 
(14.161) follows from (|4.17[) and (14. 15[) . Thus the proof of Lemma l4.6l is completed. □ 
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Recall that the constants C\ , C2 , C3 in Lemma 14. A\ Lemma 14.51 and Lemma 14.61 
depend only on s, a, n, \\u\\ H „ +e (yy) anc ^ ll a llc 2 ™+ 2 (o) ■ Now take L in such a way 
that L > max{Ci, C 2 , C 3 , 2 s+1 B a , B f , 4 n+3 (\\u\\ Hn+6{w} + 1)}. Then by the 

above three Lemmas, we get the truth of (E) T: n for any r G [0, 1]. This complete 
the proof of Proposition 14.11 

5. Gevrey regularity of nonlinear equation 

In this section, Cj,j > 4, will be used to denote suitable constants depending 
only on a, the Gevrey index s, the dimension n and the Gevrey constants of the 
functions a, F. The existence and the Sobolev regularity of weak solutions for non- 
linear Cauchy problems was proved in [15]. Now let u G ^^(M. 27 ^ 1 ) be a weak 
solution of (|1.3|) . We first prove u G C°° (R 2n+1 ) , and we need the following stability 
results by nonlinear composition (see for example |22|). 

Lemma 5.1. Let F(t,x,v,q) G C°°{R 2n+1 x E) and r > 0. If u G L% c (R 2n+1 ) n 
iff oc (R 2 » +1 ), then F(;u(-)) G fff oc (R 2 " +1 ). 

In fact, if ux,u 2 G H r (R 2n+1 ) fl L°°(R 2n+1 ), then 

||uiM 2 ||r < ^{lluilliooH^llr + ||u2||i~||ui||r}- 

Thus if r > (2n + l)/2, the Sobolev embedding theorem implies that 

(5.1) |Kw 2 ||r < C||ttl|| r ||lt 2 || r . 

Suppose that u G L^ c (R 2n+1 ) is a weak solution of (|1.3j) . Then by the subelliptic 
estimate (|2.4|) . one has 

(5.2) ||^M|r+« < C{ \\^ 2 F(; U (-))\\ r + \\Tp2u\\ r }, 

where ipi,ip2 S C^°(R 2 ™ +1 ) and ^2 = 1 in the support of tpi. Combining Lemma 
I5.1l and the above subelliptic estimate (|5 . 2[) . we have u G -ff^ c (R 2n+1 ) by standard 
iteration. We state this result in the following Proposition: 

Proposition 5.2. Let u G L^ c (R 2rl+1 ) be a weak solution of U.3\) . Then u G 
C°°(R 2 " +1 ). 

In this section we keep the same notations that we have set up in the previous 
sections. We prove the Gevrey regularity of the smooth solution u of Equation (II .3|) 

on ft. Set W = 2fl = {(t,x); (t 2 + |ir| 2 ) 1/2 < 2} x {v e R", |u| < 2} and 

M= max \u(t,x,v)\. 

Let {Mj} be a sequence of positive coefficients. We say that it satisfies the mono- 
tonicity condition if there exists Bo > such that for any j G N, 

(5.3) jl MiMj-i < B Mj, (i = 1, 2, • • • , j). 

Let Hwllpfc^-) be the classic Horder norm, that is, = X)j=o ll^ J ' u llz,°°(a) ' 

We study now the stability of the Gevrey regularity by the non linear composi- 
tion, which is an analogue of Lemma 1 in Friedman's work |11) . 
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Lemma 5.3. Let N > n + 2 and < p < 1 be given. Let {Mj} be a positive 
sequence satisfying the monotonicity condition i5.3\) and that for some constant C n 
depending only on n, 



N S n+2 



(5.4) ^—j Mjv-n-2 < C n M N - 2 ; Mj > p~>, j>2. 

Suppose that there exists C4 > 1, depending only on the Gevrey constant of F, such 
that: 

1) the function F(t,x,v;q) satisfies the following conditions: \\P\\ C rz+2^ x ^_ M M i\ < 
C4 and for any k, I with k + I > 1, 

(5.5) \\DZ^ v D l q F\\ Cn+2{rix[ _ MM]) < C k + l M k ^ 2 M^ 2 , V | 7 | = k, 



where we assume M—j = 1 for nonnegative integer j. 

2) the smooth function g{t,x,v) satisfies the following conditions: ^g^L°°(w) — 
M and 



(5-6) \\Dig\\ cn+3{w) <H , 0<j<l, 

and for any < p < 1 and any j, 2 < j < N, one has 

(5.7) \\^ pd D^\\ v+n+1 < R{- 2 M 2 -^ V | 7 | = j, 

where v is a real number satisfying —1/2 < v < 1, and Hq,Hi > 1, H\ > 
(4™+ 2 C 4J ff ) 2 . 

Then there exists Cg > 1, depending only the Gevrey constant of F and the 
dimension n, such that for all p,0 < p < 1, and all a € P} 2 ™+ 1 with \a\ = N , 

(5.8) \\® PtN D a [F(;g(-))]\l +n+1 <C 5 H*H»- 2 M N - 2 . 

Proof. In the proof, we use C n to denote constants which depend only on n and 
may be different in different contexts. In the following, for each p, we always denote 

- (N-l)p ~ (N-2)p 
9 N ' N 



Observe that for p, p, p, we have the relation (J4T2J). Since $^3 = 1 in the support 
of then by Lemma [XU one has 



\\$ PtN D a [F(;g(-))]\l +n+1 = \\$ PiN <t>- p , 3 D<*[F(-,g(-))]\l +n+1 

< C n {\\^^D a [F(;g(-))}\l +n+1 + f-Y " ||$^«[F(, ff (.))]|| } 



2- 



The proof will be completed if we can show that there exists a constant £ depending 
only the Gevrey constant of F and the dimension n, such that 



(5.9) X x < £H 2 H?~ 2 M N „ 2 
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Indeed, choose a multi-index a < a such that |a| — n. Then 



jy\ n+l+v 



X 2 = C n I — ) \\<f^D a <i>= i3 D a - a [F(;g(-))]\\ 

- Cn {j) H%3^ Q [n-,5(-))]|L 
fN\ n+2 u 

^(7) ll^.3^ Q [ F (^(-))]|L + „ +1 . 

Assuming that (|5.9I) holds, then by virtue of the condition (|5.4p . we have 

/ N \ 11+2 //V\" +2 
X 2 < C n - 11$= 3^- fi [F(, g (.))]||, y+r , +1 < C„ - EHtH N - n -Hl 



P 

2 £7^-2 ; 



N-n-2 



< C n £H H Mn-2- 

With (|5.9p . the conclusion follows at once. 

The rest is devoted to the proof of ( |5.9I) . By Faa di Bruno' formula, $p )3 D a [F(-, g{-))\ 
is the linear combination of terms of the form 

1 

(5.10) $- p , s (Dl XiV d l g F)(-,g(.)).l[mg, 

where |/3| + 1 < \a\ and 71 + 72 + • ■ • + 7; = a — /3, and if 7; = 0, -D 7i g doesn't 
appear in (|5.10|) . 

Next we estimate the Sobolev norm of the form (|5.10[) . Take a function $ G 
C^{W) such that * = 1 in ft. Note that n + 1 + v > (2n + l)/2. We apply (l5Tj) 
to compute 



v+n+l 



3 = 1 



< ii* A 8 (•^(•wiu+i • n 11*^*1 



+n+l' 

3=1 



where *j is given by setting VPj = $ if |7j| = 1, and $fj = $= , . if |7j| > 2. 
Moreover a direct computation yields 

11**3 (dI*A f ) (■.fl(0)L +n+1 < II*p,3 (^^f) (•^(•))|| Il+2 

< CniJo {sup |£>™ +2 $p, 3 | • ll^^^-PllocnxhM.M]) + \\ D L,vd l <i F \\c^(nx{-M,M])} 



n+2 



<C n H${ [ ) ll^i,t)^^|c!(nx[-M,Af]) + II^M^9^llc™+ 2 (nx[-M,M]) 



In the last inequality, we have used (|3.ip . Without loss of generality we may assume 
> n + 2. Then we may choose < such that |/3| = |/3| — (n + 2). Thus by 
|), (|5.5p and the monotonicity condition (|5.3I) . one has 

l|- D ^,« a 8- F llc»+ 2 (nx[-A ! f,Af]) " M l/3|-2 M *-2, 
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and 



h+2 



\ ly t,x,v u q r \\c(nx[-M,M]) 



<i 3 - 



n+2 



\ ±y t,x,v u q r llc™ + 2 (fix[-M,M]) 



< T +2 M n+2 M^ 2 M^ 2 

< 3™+ 2 M| /3 |_ 2 M i _ 2 . 



Hence, 



Hence 
(5.11) 



p, 3 (#L^'f) (•,<?(•)) L +n+1 < C n H M M _ 2 M^ 



1**3 (A**,,^) (•,5(-))II^ 7 ^IU+n+i < C n H M m _ 2 M^ ||%D T ^l +n+1 , 



i=i 



By virtue of (|5.6p - (|5.7l) and f|5 . 10[) - (15 . 1 1[) . the situation is now similar to [11] . In 
fact, we work with the Sobolev norm, and we shall follow the idea of |llj to prove 
(|5.9[) . First we define the polynomial functions w, X\, X 2 in R as follows: 



w = w(y) = H a \y + jf J 



Xi(w) = i + e 4 w + 2^ V — 



j=2 



A' 



X 2 (y) = l+C 4 y + ^ 



i=2 



By the conditions (I5.6P and (I5.7[) . we have 



< 



, y e 



, Vl<j<iV; 



Define X(y,w) — Xi(w)X 2 (y). Then by virtue of (|5.5[) . it follows 

d k+l X(y,w) 



M Jfe _ 2 Mi_2 < 



dy k dw l 



(j/,™)=(0,0) 



V 2 < k, I < N. 



By (|5.11[) and the above two inequalities, we get that for all a, |a| = iV, 



Xi = C„||l>p,3^ Q [F(-, ff (-))]L +n+1 < CnHo-^X (y,w(v)) 

Hence, the proof of (|5.9[) will be complete if we show that, 
d N 

— (A, [«•(//)) A ,(//!) 



y=0 



(5.12 



N (X, (w(yj) X 2 (y)) n < 72C i H H?- 2 M N _ 2 . 
To prove the above inequality, we need to treat ^^(O) := -^Xj(y) 



< 



k < N, j = 1, 2. We say w(y) <C /i(y) if the following relation holds: 

w u) (0) < h U) (0), 0<j<iV. 
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Observe that 



w(y) « w(y) =H \y + J2 J I 



We can prove that 

(5.13) w 2 ( y )«35^ f/r -X"' 



In fact, a direct verification shows that 



Since {Mj} satisfies the monotonicity condition (|5.3I) . we compute 

J ^ //•/ -M, j.U, , i 4J?r 4 M J -- 4 ^ j 2 32gr 3 Af 3 _ 3 
^ i!(j-OI " (j-4)!j 2 ^i 2 C3-i) a " 0" — 1)1 ' 
Combing these, we obtain (|5.13|) . Inductively, we have the following relations: 

Thus by the definition of Xi, it follows that 

X x (t/) = X x (w(y)) « 1 + dHoy + (H M /2 + 35C 4 2 Af ff 2 /2) y 2 

A / //.,//, ■ 35' , ^ 35 i - 1 clgggr i ~ 1 ^-2M 3 -- i -i > 

-< + !)! 



This gives 

Xi (0) = 1, (0) < C 4 tf , X : (2) (0) < H M + 35C 2 M tf 2 , 
and moreover for j > 3, 

xp')(o) < cy/„/// 2 m, 2 .35< f;// ; ;j/, a +£ .'-)|; ' ' 

Observe that H 1 > (35C 4 ff ) 2 , and hence X (2) < 2C A H H 1 M , and for j > 3, 



2 



(i _ 3)! ^i 2 (i-i) 5 



< 6C 4 H Hi~ 2 M 3 - 2 



-2- 

On the other hand, it is clear that 



X 2 (0) = 1, X^(0) < C 4 , X^ j (0) < CiMi-2, 2 < j < N. 
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By virtue of the above relations, we have, for Hi > {ZhCiHo) 2 , 
d N , , k4 A N\ 



x <*Mv)) y=0 - E ^r^^W^W 



< Cf M N -2 + C?NH M N - 3 + 2N(N - l)Cf ^HqHiMoMn-a + 6CjH H^ 3 M N - 3 

N - 2 N\ 

+ 6C 4 H H?- 2 M N „ 2 + 6C 4 V " - HoH^Mj^-'Mn^ 

< 72C i H a H?- 2 M N - 2 - 

This gives (|5.12|) , and hence (|5.9j) . This completes the proof of Lemma 15.31 □ 

Now starting from the smooth solution u, we prove the Gevrey regularity result 
as follows: 

Proposition 5.4. Let 5 — max{|-, § — g} > and let s > | foe a rea/ number. Let 
W = 20, = {(t,x,v); (5,1,3) e ^} • Suppose that u 6 C°°(W^) is a solution of 
173)) w/iere o(t,x,«) € G s (Q),a > and F(t,x,v,q) € G s {0 x [— M, M]). J7ien 
i/iere exits a constant R such that for any r £ [0, 1] and any iV 6 N, iV > 4, 

( W <^^T((H-3)!) s (f) Sr 
holds for all a, |a| = N and all < p < 1. Thus, u £ G s (f2). 

Remark 5.1. Here the Gevrey constant L of it is determined by the Gevrey con- 
stants J5 a and Bp of the functions a,F, and depends only on s, cr,n, IMI^n+e^) 
and ||a|| c2 „ +2(n) . 

Proof. We prove the estimate (£% jy by induction on AT. We shall follow the same 
procedure as that in the proof of Proposition 14.11 First, the truth of {E)' r4 can 
be deduced by the same argument as that in the proof of (E) r ^ i n the previous 
section. 

Let now N > 4 and assume that (E)' rN _ 1 holds for any r € [0, 1]. We need to 
prove the truth of (E)' r N for < r < 1. In the following discussion, we fix TV and 

for each < p < 1, define p = ^jj^P, P = H\T^P- Let $ p .at be the cutoff function 
which satisfies the property (|3.1[) . 

First, the same argument as the proof of Lemma l4~4l yields 
(5.14) 

\\$ p>N D a u\\ n+1 + \\$ p>N A°D"u\\_s 2+n+1 < ( ^ ( | a ,_ 2 8) ((|al-3)!) s , V0<p<l. 

Next we prove, for all r, < r < |, 
(5-15) 

\\^ p , N D a u\\ r+n+1 + \\<!> p , N A°D a u\\ r _s +n+1 < -ggl_!_((|a| - 3)!)'(i\T/p)"\ 

Observe that we need only to show the above inequality in the case when r = |, 
that is 

(5.16) ||$ p , Jv ^n|| f+ „ +1 + ||$ p ^A^ Q n||„ +1 < p ^ a{ l 3) ((|a[ -3)!) s (JV/p)^ , 
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and the truth of (|5.15|) for general r €]0, f [ follows by the interpolation inequality 
To prove (|5.16l) . we first show the following inequality 

(5.17) \\V* PtN D a u\\_s +n+1 < fj^ { 2 _ 3) ((\a\ m S (N/p)^- 
In fact, 

\\V$ p , N D a u\\_ i+n+1 < \\[P, $ PlN D a }u\\_ i+n+1 + \\$ p , N D a Vu}\_ i+n+1 

< \\[P, <£ P , N D a }u\\_s +n+1 + \\<t> p , N D a {F(;u(-))}\\-i +n+ v 

Since there is no nonlinear form involved in the first term of the right-hand side of 
the above inequality, the same argument as in the proof of (|4.9|) gives that 

(5.18) \\[V, $ P , N D<*]u\\_ i+n+1 < p ^~l 3) ((\a\-3Vr(N/ P ^, 

Thus we need only to treat the second term \\^ p ^ N D a [F(-,u(-))]\\_s +n+1 . The 
smoothness of u gives 

(5.19) ll^«||o»+»(«0 < \\u\\ C n +H w), < j < 2, 

and by the induction hypothesis, for any 3 < j < N and any < p < 1, 

||$ P ,^m + „ +1 < U^NUr < S^3) ((^3)!) s 

(5.20) ._ 2 9 

<-^S^((j-*yYU/p)^> V/3,|/3|=i, 

Similarly, by (|5.14[) . we have for any < p < 1, 

C R N ~ 2 

(5.21) \\$ PlN D a u\\_s +n+1 < {s l n)(N _ 3) ((N 3)!) s (iV/p)^, V a, \a\ = N. 
Since F e G s (fl x [-M, M]), then 

(5.22) \\Dl XtV d l q F\\ Cn+2{nx[ _ M>M]) <B h F +l ((k~3y.) s ((l-3y.) s , k,l>3. 
Define Mj , H , Hi by setting 

H X = R; Ho = \\u\\ cn+3m + 1; M = 1; M 3 = + 2)/p)# , j > 1. 

We can choose R large enough such that H 1 = R > (A n+1 B F H Q ) 2 . Then (|5~T<?)) - 
(15.221) can be rewritten as 

(5.23) \\D^u\\ cn+3{W) < H , 0<j<l, 
(5.24) 

||<E>p^ 7 "IU + „ +1 < H Q H{- 2 M^ 2 , V < p < 1, V | 7 | =j, 2<j<N, 



(5.25) ||A fc ^ilc"+2(Ox h Af,Af]) <B F +l M k _ 2 M^, k,l>2. 
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For each j, note that s > | . Hence we compute 
(5.26) 

x (i + 2)^0'-i + 2)^p- ;i ' 5 
< - 2)rryCs+*)W- 2 )(j + 2)f (j + 2) V sA ~ 

jC^+2)^ 

In the last inequality we used the fact that s — 1 > 1 + 4^, where C s is a constant 
depending only on s. Moreover, it is easy to verify that, Mj > p _ ( s + n )u— !) > p~i 
for each j > 2, and 

iVV l+2 n/f _/iYV i+2 ((7V-n-3)!) 



P / VP 



- ) M JV _ n _ 2 = ( - ) ( (jv - n )/p) 



((N-1Y) S 5 

< C " p (s+n ){ N + 2 )/P)^ = C ^N-2- 

Thus {Mj} satisfies the monotonicity condition (|5.3p and the condition (|5.4I) . By 
virtue of (|5.23p - (|5.26[) , we can use Lemma T5.3I with v = — | > —4 to obtain 

\\$ p , N D a [F(.,u(-))]\\-§ +n+ i < Cs^^^aM 

< 2C 5 (l + \\uf cn+3m ) p(s ^_ 3) ((\a\ - 3)1)' Wp)' 

This along with ([5TTg|) yields (j5~TT|) . if we choose C 7 = C 8 + 2C 5 (l + ||^Ho"+ 3 (VK) 
By virtue of (|5.17[) . we can repeat the discussion as in Step 4 in the previous section. 
This gives (j5~Tb]) , and hence ([5351) . 

Similarly, we can prove that for any r with | < r < 6, 

|]^]] r+n+1 ,n p + ||A^|| r _ |+n+1)np < ^'^ 3 ) ((l"l-3)0'(W r - 

Inductively, for any m E N with ^ < 1 + |, the above inequality still holds for 
any r with ( T "~ 1 )' 5 < r < inA, Hence, for r with < r < 1, we obtain the truth of 
(E)' rN . This completes the proof of Proposition I5T41 □ 
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